LIA @ MediaEval 2013 Crowdsourcing Task: Metadata or not Metadata? That is a Fashion Question
نویسندگان
چکیده
In this paper, we describe the LIA system proposed for the MediaEval 2013 Crowdsourcing for Social Multimedia task. The aim is to associate an accurate label to an image among multiple noisy labels collected from a crowdsourcing platform. In particular, the task participants have to predict two types of binary labels for each considered image. The first one mentions that an image is truly fashion-related or not, while the second label indicates that the fashion tag assigned to the image is related to the content of the image or not. The proposed system combines noisy crowdsourcing labels, image metadata and external resources.
منابع مشابه
Crowdsourcing for Social Multimedia at MediaEval 2013: Challenges, Data set, and Evaluation
This paper provides an overview of the Crowdsourcing for Multimedia Task at MediaEval 2013 multimedia benchmarking initiative. The main goal of this task is to assess the potential of hybrid human/conventional computation techniques to generate accurate labels for social multimedia content. The task data are fashion-related images, collected from the Web-based photo sharing platform Flickr. Eac...
متن کاملAn Investigation of Techniques that Aim to Improve the Quality of Labels provided by the Crowd
The 2013 MediaEval Crowdsourcing task looked at the problem of working with noisy crowdsourced annotations of image data. The aim of the task was to investigate possible techniques for estimating the true labels of an image by using the set of noisy crowdsourced labels, and possibly any content and metadata from the image itself. For the runs in this paper, we’ve applied a shotgun approach and ...
متن کاملCrowdsorting Timed Comments about Music: Foundations for a New Crowdsourcing Task
This paper provides an overview of the Crowdsorting Timed Comments about Music Task, a new task in the area of crowdsourcing for social media offered by the MediaEval 2014 Multimedia Benchmark. Data for this task is a set of Electronic Dance Music (EDM) tracks, collected from online music sharing platform Soundcloud. Given a set of noisy labels for segments of Electronic Dance Music (EDM) that ...
متن کاملSQUARE: Benchmarking Crowd Consensus at MediaEval
We extend the square benchmark for statistical consensus methods to include additional evaluation on two datasets from the MediaEval 2013 Crowdsourcing in Multimedia shared task. In addition to reporting shared task results, we also analyze qualitatively and quantitatively performance of consensus algorithms under varying supervision. 1. ALGORITHMS We extend square [5], a benchmark for evaluati...
متن کاملEfficient Crowdsourcing for Metadata Generation
Rich and correct metadata still plays a central role in accessing data sources in a semantic fashion. However, at the time of content creation it is often virtually impossible to foresee all possible uses of content and to provide all interesting index terms or categorizations. Therefore semantic retrieval techniques have to provide ways of allowing access to data via missing metadata, which is...
متن کامل